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PREFACE 



In 1995, Richard E. Snow wrote in CRESST's proposal to the Office of 
Educational Research and Improvement that his previous work showed that 
"psychologically meaningful and useful subscores can be obtained from 
conventional achievement tests" (Baker, Herman, & Linn, 1995, p. 133). He went on 
to point out that these subscores represented important ability distinctions and 
showed different patterns of relationships with demographic, "affective" 
(emotional), "conative" (volitional), and instructional-experience characteristics of 
students. He concluded that “a new multidimensional approach to achievement test 
validation should include affective and conative as well as cognitive reference 
constructs" (italics ours, p. 134). 

Snow (see Baker et al., 1995) left hints of what he meant by "a new 
multidimensional approach" when he wrote, "the primary objective of this study is 
to determine if knowledge and ability distinctions previously found important in 
high school math and science achievement tests occur also in other multiple-choice 
and constructed response assessments. ... A second objective is to examine the 
cognitive and affective correlates of these distinctions. And a third objective is to 
examine alternative assessment designs that would sharpen and elaborate such 
knowledge and ability distinctions in such fields as math, science, and history- 
geography" (p. 133). 

We, as Snow's students and colleagues, have attempted to piece together his 
thinking about multidimensional validity and herein report our progress on a 
research program that addresses cognitive and motivational processes in high 
school science learning and achievement. To be sure, if Dick had been able to see this 
project through to this point, it might well have turned out differently. Nevertheless, 
we attempted to be true to his ideas and relied heavily on the theoretical foundation 
of his work, his conception of aptitude (Snow, 1989, 1992). 

Snow called for broadening the concept of aptitude to recognize the complex 
and dynamic nature of person-situation interactions and to include motivational 
(affective and conative) processes in explaining individual differences in learning 
and achievement. Previous results, using a mixed methodology of large-scale 
statistical analyses and small-scale interview studies, demonstrated the usefulness of 
a multidimensional representation of high school science achievement. We 
identified three distinct constructs underlying students' performance on a 
standardized test and sought validation evidence for the distinctions between "basic 
knowledge and reasoning," "quantitative science," and "spatial-mechanical ability" 
(see Hamilton, Nussbaum, & Snow, 1997; Nussbaum, Hamilton, & Snow, 1997). 
Different patterns of relationships of these dimensions with student background 
variables, instructional approaches and practices, and out-of-school activities 
provided the groundwork for understanding the essential characteristics of each 
dimension. We found, for example, that gender differences in science achievement 
could be attributed to the spatial-mechanical dimension and not to aspects of 
quantitative reasoning or basic knowledge and facts. 
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Our studies, reported in the set of six CSE Technical Reports Nos. 569-574,* 
extend the groundwork laid down in Snow's past research by introducing an 
extensive battery of motivational constructs and by using additional assessment 
formats. This research seeks to enhance our understanding of the cognitive and 
motivational aspects of student performance on different test formats: multiple- 
choice, constructed response, and performance assessments. The first report 
(Shavelson et al., 2002) provides a framework for viewing multidimensional 
validity, one that incorporates cognitive ability (fluid, quantitative, verbal, and 
visualization), motivational and achievement constructs. In it we also describe the 
study design, instrumentation, and data collection procedures. As Dick wished to 
extend his research on large-scale achievement tests beyond the National Education 
Longitudinal Study of 1988 (NELS:88), we created a combined multiple-choice and 
constructed response science achievement test to measure basic knowledge and 
reasoning, quantitative reasoning, and spatial-mechanical ability from questions 
found in NELS:88, the National Assessment of Educational Progress (NAEP), and 
the Third International Mathematics and Science Study (TIMSS). We also explored 
what science performance assessments (laboratory investigations) added to this 
achievement mix. And we drew motivational items from instruments measuring 
competence beliefs, task values, and behavioral engagement in the science 
classroom. The second report in the set (Lau, Roeser, & Kupermintz, 2002) focuses 
on cognitive and motivational aptitudes as predictors of science achievement. We 
ask whether, once students' demographic characteristics and cognitive ability are 
taken into consideration, motivational variables are implicated in science 
achievement. In the third report (Kupermintz & Roeser , 2002), we explore in some 
detail the ways in which students who vary in motivational patterns perform on 
basic knowledge and reasoning, quantitative reasoning, and spatial-mechanical 
reasoning subscales. It just might be, as Snow posited, that such patterns interact 
with reasoning demands of the achievement test and thereby produce different 
patterns of performance (and possibly different interpretations of achievement). The 
fourth report (Ayala, Yin, Schultz, & Shavelson, 2002) then explores the link between 
large-scale achievement measures and measures of students' performance in 
laboratory investigations ("performance assessments"). The fifth report in the set 
(Haydel & Roeser, 2002) explores, in some detail, the relation between varying 
motivational patterns and performance on different measurement methods. Again, 
following Snow's notion of a transaction between (motivational) aptitude and 
situations created by different test formats, different patterns of performance might 
be produced. Finally, in the last report (Shavelson & Lau, 2002), we summarize the 
major findings and suggest future work on Snow's notion of multidimensional 
achievement test validation. 



*This report and its companions (CSE Technical Reports 569, 571, 572, 573, and 574) present a group 
of papers that describe some of Snow's "big ideas" with regard to issues of aptitude, person-situation 
transactions, and test validity in relation to the design of a study (the "High School Study") 
undertaken after Snow's death in 1997 to explore some of these ideas further. A revised version of 
these papers is scheduled to appear in Educational Assessment (Vol. 8, No. 2). A book based on Snow's 
work. Remaking the Concept of Aptitude: Extending the Legacy of Richard E. Snow, was prepared by the 
Stanford Aptitude Seminar and published in 2002 by Lawrence Erlbaum Associates. 
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ON COGNITIVE ABILITIES AND MOTIVATIONAL PROCESSES IN 
STUDENTS' SCIENCE ENGAGEMENT AND ACHIEVEMENT 

Shun Lau and Robert W. Roeser, Stanford University 
Haggai Kupermintz, CRESSTAJniversity of Colorado, Boulder 



Abstract 

This study examined how cognitive and motivational factors jointly contributed to 
science achievement, engagement, and choice of science-related majors and careers in a 
sample of 491 high school students. Students completed cognitive and motivational 
measures in three different sessions: (a) a survey of motivational processes, including 
competence beliefs, task values, and behavioral engagement in the science classroom; (b) 
assessments of fluid, crystallized, and spatial abilities; and (c) a science achievement test. 
Results of regression analyses showed that the inclusion of motivational variables 
enhanced the predictive validity for science achievement. General ability was the 
strongest predictor of achievement outcomes, whereas motivational variables were the 
strongest predictors of engagement and choice. General ability had a direct effect on 
achievement and an indirect effect through the mediation of competence beliefs. 
Competence beliefs and task values had direct effects on achievement and indirect effects 
through the mediation of engagement. The study highlights the differential predictive 
validity of cognitive and motivational factors for different types of outcome and 
corroborates the mediational pathways linking self-system processes, action, and 
outcomes. 



In his new aptitude theory, Snow (1989, 1992) broadened the concept of 
aptitude to include morivational and affective characteristics of persons, not just 
their cognitive abilities. He proposed that cognitive abilities and motivation 
contributed to effecrive funcrioning through two unique pathways — a performance 
pathway and a commitment pathway. The performance pathway describes the 
processes by which cognitive resources are activated, retrieved, assembled, and 
executed in the service of accomplishing parricular tasks. The commitment pathway 
describes a parallel process by which motivarional resources are acrivated in the 
service of guiding and energizing behavior toward particular goals in a given 
situation. Snow's revised theory highlights the full spectrum of cognitive and 



* An earlier version of this report was presented at the annual meeting of the American Educational 
Research Association in Seattle, Washington, in April 2001 under the title Cognitive Abilities and 
Motivational Processes in High School Students' Science Engagement and Achievement, 



motivational resources that are involved with an individual's preparation for and 
actual engagement with particular tasks such as completing a science achievement 
test or a class project. 

As in other areas of academic achievement, research on science achievement 
has focused primarily on the cognitive determinants. Undoubtedly, intelligence has 
a significant influence on academic achievement. A vast body of research has 
provided consistent evidence for the link between IQ and academic achievement (for 
reviews, see Jensen, 1998; Matarazzo, 1972; Snow & Yalow, 1982). Yet, as Snow 
recognized, cognition alone presents too narrow a view of achievement. First, a 
typical mean correlation between IQ and academic achievement reported in the 
literature is about .50 (Jensen, 1998). This implies that IQ accounts for about 25% of 
the variance in achievement, and that about 75% of the variance is explained by 
factors other than IQ. Second, research on expertise has provided ample evidence 
that expert performance is the end result of individuals' prolonged efforts to 
improve performance (Ericsson & Charness, 1994). Individual differences in the 
levels of performance are closely related to the amount of deliberate practice. In a 
wide range of domains, eminent performance requires sustained practice over a 
minimum of 10 years (Ericcson & Lehman, 1996). Third, zeal for life-long learning 
and self-improvement should be regarded as a valued end in itself. An increasingly 
knowledge-dependent society demands that workers continuously upgrade 
themselves. The motivation to sustain lifelong pursuit of knowledge beyond the 
confines of the classroom is as important as, if not more important than, the 
acquisition of skills and knowledge. 

The limitations of the cognitive view underscore the need for moving beyond 
cognitive factors in accounting for performance. This study sought to enhance our 
understanding of conjoint influences of cognitive and motivational factors on 
academic performance and achievement-related behavior. To this end, we drew on 
several contemporary theories of human ability and motivation to construct our 
conceptual model. 

Toward an Integrated Model of Cognitive and Motivational Processes 
in Science Task Engagement and Performance 

Following from Snow's overarching notion of aptitude, we attempt here to 
integrate cognitive and motivational theories (see Shavelson et al., 2002). We begin 
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with cognition, then move to motivation, and conclude with an integrative, "self" 
framework. 

Carroll's Theory of Human Cognitive Ability 

In order to more fully elaborate the cognitive resources that we believe 
constitute the performance pathway for the kinds of science performance outcomes 
we were interested in (e.g., standardized tests and teacher-rated grades), we drew 
on Carroll's three-stratum model of human cogmtive ability (Carroll, 1993). Carroll's 
model encompasses three broad cognitive abilities relevant to science performance: 
fluid, crystallized (verbal and quantitative), and spatial abilities. These cognitive 
factors are considered to be important aptitude resources that reflect students 
learning histories and are organized as a repertoire of mental schemes, response 
sets, knowledge and skill components, and heuristic problem-solving strategies 
(Snow, 1992). Different mixes of these aptitude resources, in conjunction with 
motivational and situational factors, shape task engagement and performance. 

Expectancy- Value and Self-Efficacy Theory 

In order to more fully elaborate the motivational resources that we believe 
constitute the commitment pathway for the science engagement and choice 
outcomes that we examined in this study, we drew upon Eccles-Parsons et al.'s 
(1983) expectancy-value theory and Bandura's (1997) self-efficacy theory. 
Motivational theories are particularly useful for describing different patterns of 
engagement with (commitment to) particular tasks. 

Expectancy-value theory is a social-cognitive theory of motivation that posits 
that individuals' task-related expectancies for success and values serve the function 
of preparing and energizing individuals to engage with a task, to seek out task 
challenges, to persist at particular tasks, and to choose certain activities in their free 
time. Eccles-Parsons et al. (1983) defined expectancy as individuals' beliefs about 
how well they would perform on future tasks in a given domain. Values were 
defined as individuals' perceived importance of and intrinsic interest in certain 
tasks, their perceived utility of a given task in relation to the attainment of other 
desired goals, and the perceived cost of engaging in a particular task. In a series of 
studies that examined how expectancy and value were related to academic 
achievement and choice of academic tasks, Eccles and her colleagues (Eccles, 1984; 
Eccles, Adler, & Meece, 1984; Eccles-Parsons et al, 1983) found that expectancies for 
success predicted achievement in mathematics and English, whereas task values 



predicted both course-taking intentions and actual subsequent course enrollment 
decisions in these domains. In sum, for Eccles and her colleagues, expectancies 
related most closely to achievement, and value to choice. In this study, we used 
Eccles' notion of task values, but instead of focusing on perceived expectancies for 
success, we used Bandura's (1997) concept of self-efficacy to describe the 
motivational resources that define the commitment pathway. 

Bandura (1997) defined self-efficacy as "beliefs in one's capabilities to organize 
and execute the courses of action required to produce given attainments" (p. 3). In a 
review of the contribution of perceived self-efficacy to cognitive functioning, 
Bandura (1993) explicated diverse pathways through which self-efficacy exerts its 
impact. For example, in a study of mathematics skills development, self-efficacy was 
found to enhance the mastery of mathematics skills directly by affecting the quality 
of thinking and use of acquired knowledge and skills, and indirectly by increasing 
persistence in the search for task solutions (Schunk, 1984). Thus, whereas values 
have been linked to behavioral choices, self-efficacy has been most closely associated 
with performance and persistence. In sum, these models highlight the idea that 
different motivational resources (e.g., beliefs and values), in conjunction with 
aptitude and situational factors, shape task engagement, performance, and choice. 

Self-System Theory 

The final conceptual framework we drew on in conceptualizing the 
commitment pathway was derived from Connell and Wellborn's (1991) self-system 
model of motivation. This model outlines linkages among context, self, action, and 
outcome variables. The model consists of hypothesized linkages among individuals' 
experience of the social context (e.g., provision of structure by teachers), their self- 
system motivational processes (e.g., competence beliefs), their patterns of action 
(e.g., cognitive and behavioral engagement), and actual performance outcomes (e.g., 
grades and achievement test scores). A notable feature of this model is its explicit 
formulation of the connection between motivational (self-system) processes and 
performance outcomes through the mediation of action. Action is defined as the 
individual's quality of engagement with a task. Connell and Wellborn proposed that 
motivational processes related to performance outcomes mainly by affecting 
whether or not an individual attends to, persists in, and engages in a task. 



O 

ERIC 



4 



10 



Conceptual Model 

We drew on the themes and constructs from each of the theoretical models just 
reviewed to construct the conceptual model guiding this study. We assumed that 
self-system processes, consisting of both cognitive resources (performance pathway) 
and motivational resources (commitment pathway) would predict achievement and 
choice outcomes mainly through their impact on action (patterns of task 
engagement). In addition, the inclusion of both achievement and choice outcomes 
was informed by Eccles et al.'s (1983) finding of differential predictive validity of 
expectancy and value. Figure 1 presents the general conceptual model for our study. 

Purposes and Research Questions 

This study was designed to examine the network of relations (both direct and 
mediated) among self-system processes, action, and outcomes. Our primary goal 
was to understand how cognitive and motivational variables jointly contributed to 
the prediction of science achievement and choice of science-related majors and 
careers. We asked three specific research question: (a) How much incremental 
predictive validity do motivational variables contribute to science achievement 
above and beyond the contributions of cognitive and demographic variables? (b) 
How do the relative contributions of motivational and cognitive factors vary with 
types of outcome (e.g., performance and choice)? And (c) how do patterns of action 
(e.g., engagement in classroom and test-taking situations) mediate the relation 
between motivational processes and science achievement? 





5 1 i 



Figure 1. Conceptual model. 



Method 



Participants and Procedure 

High school students (N = 491) enrolled in science classes in a northern 
California high school participated in the study during the 1999-2000 academic year. 
In the first semester, students completed cognitive and motivational measures in 
two different sessions: (a) a survey of motivational processes and background 
characteristics (e.g., gender, ethnicity, parental education); and (b) assessments of 
fluid, crystallized (verbal and quantitative), and spatial abilities. In the second 
semester, student took a science achievement test consisting of multiple-choice 
items. Second-semester science grades were also collected from teachers of the 
participants. 

Measures 

Cognitive abilities. Four measures were used to evaluate students' fluid, 
crystallized (verbal and quantitative), and spatial abilities. Two tests from the 
Educational Testing Service's Kits (French, Ekstrom, & Price, 1963) were 
administered to measure fluid (hidden figures test) and spatial (cube comparisons 
test) abilities. The measure of crystallized quantitative ability included items from 
the National Education Longitudinal Study of 1988 (NELS:88), which were 
investigated in a previous study (Kupermintz & Snow, 1997), whereas the measure 
of verbal ability included items from a practice Standardized Achievement Test 
(SAT). 

A principal-components factor analysis was conducted on the four cognitive 
ability measures (mathematics, verbal, hidden figures, and cube comparisons tests). 
The analysis yielded one factor with an eigenvalue greater than 1. The factor 
accounted for 50% of the total variance. Table 1 presents the factor loadings for the 
cognitive ability tests. Cronbach's a for the factor was .67. Factor scores representing 
the general ability composite were derived from the four ability measures, and these 
factor scores were used in subsequent analysis. 

Motivational processes. Motivational constructs included (a) students' 
efficacy beliefs about their ability to master science content and their ability to 
perform well on different types of science assessments (Bandura, 1997), as well as 
their confidence in their abilities in the domain of science (Dweck, 1986), and 
(b) students' values about science, including interest, usefulness, and importance 
(Eccles & Wigfield, 1995). 



Table 1 



Factor Loadings for Cognitive Ability Tests {N = 406) 



Cognitive ability test 


Factor: General ability 


Math test score (crystallized quantitative ability) 


0.804 


Verbal test score (crystallized verbal ability) 


0.734 


Cube comparisons test score (spatial ability) 


0.662 


Hidden figures test score (fluid ability) 


0.625 



To examine the factor structure of competence beliefs and task values items, a 
principal-components factor analysis with oblique rotation (oblimin) was conducted. 
A two-factor structure emerged from the analysis. The first factor, competence 
beliefs, included test-specific efficacy, Dweck's confidence beliefs, and efficacy for 
mastering science content. The second factor, task values, included interest, 
importance, and usefulness of science. These two factors accounted for 72% of the 
total variance, and they show high internal consistency (a = .85 for task value and a 
= .83 for competence beliefs). Table 2 presents the factor loadings for each variable 
and the inter-factor correlation. 



Table 2 

Factor Loadings for Competence Beliefs and Task Values Variables and Factor Correlations (N = 394) 







Factor 




1 


2 


Variable 


Task values 


Competence beliefs 


I think learning science is important. 


0.89 


-0.10 


How useful is what you learn in science? 


0.86 


-0.08 


Compared to other subjects, how important is science to you? 


0.78 


0.14 


I find science interesting. 


0.69 


0.23 


Dweck's confidence (scale) 


-0.03 


0.89 


Efficacy for multiple-choice test (scale) 


-0.01 


0.86 


Science mastery efficacy (scale) 


0.07 


0.82 




Factor correlations 


Factor 1 


— 




Factor 2 


0.44 


— 



Note, Factor loadings > .40 are boldfaced. 



Science engagement. We measured two types of engagement: classroom 
engagement and test engagement. Classroom engagement was assessed by students' 
self-reports of how much attention they paid in class, their degree of participation in 
science activities, amount of homework completed, and their involvement in self- 
regulated learning activities. To assess test engagement, a survey was administered 
right after students took the science achievement test. The test engagement measure 
assessed students' use of cognitive strategies, mood, energy level, and effort 
expended during the science test. 

A principal-components factor analysis on engagement measures with oblique 
rotation (oblimin) revealed a two-factor structure. Table 3 presents the factor 
loadings and inter-factor correlation for the two-factor model. The first factor, test 
engagement, included test mood, test energy, use of test-taking strategies, and effort 
expended during the test. The second factor, classroom engagement, included 
behavioral engagement, homework completed, and self-regulation in science class. 
These two factors accounted for 60% of the total variance and had acceptable 
internal consistency (a = .76 for test engagement and a = .66 for classroom 
engagement). 

Science achievement. The science achievement measure used in this study 
consisted of the 30 multiple-choice items drawn from the National Education 



Table 3 

Factor Loadings for Engagement Variable and Factor Correlations (N = 324) 







Factor 




1 


2 


Variable 


Test engagement 


Classroom engagement 


Test mood 


0.83 


-0.12 


Test energy 


0.77 


-0.05 


Test effort 


0.77 


0.07 ^ 


Test-taking strategies (scale) 


0.58 


0.39 


Classroom engagement (scale) 


0.11 


0.77 


Self-regulation (scale) 


0.06 


0.76 


Homework completed 


-0.15 


0.74 




Factor correlations 


Factor 1 


— 




Factor 2 


0.25 


— 



Note. Factor loadings > .40 are boldfaced. 



Longitudinal Study of 1988, the National Assessment of Educational Progress, and 
the Third International Mathematics and Science Study. We also collected students' 
second-semester science grades from school records. Cronbach's a for the science 
achievement test was .82. 

Choice. This measure was assessed by three items on which students indicated 
their anticipation and intention to take science courses in college, major in science, 
and pursue science-related careers in the future. Cronbach's a for this measure was 
.62. 



Results 

We use the multiple regression technique of path analysis to bring our data to 
bear on the three questions addressed in this report; (a) Do motivational variables 
increase the predictive validity of science achievement after both student 
demographic characteristics and ability have been taken into consideration? (b) Do 
the relative contributions of cognitive and motivational factors vary with type of 
outcome? And (c) do patterns of action (in class and on the test) mediate 
motivational processes and science achievement? 

Descriptive Statistics and Hierarchical Regressions 

Table 4 presents the means, standard deviations, and number of cases for the 
variables used in path analyses. Table 5 presents the zero-order correlations for the 
variables. 



Table 4 

Descriptive Statistics 



Variable 


M 


SD 


N 


Science test scores 


16.17 


5.65 


343 


Science second-semester grades 


76.81 


16.78 


213 


Choice of science majors or careers 


0.47 


0.35 


435 


Test engagement composite 


0.00 


1.00 


324 


Classroom engagement composite 


0.00 


1.00 


324 


Competence beliefs composite 


0.00 


1.00 


407 


Task values 


3.35 


0.93 


438 


General ability 


0.00 


1.00 


406 


Parental education 


5.14 


2.43 


431 
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Hierarchical regression analyses were conducted to derive the hypothesized 
path model (Figure 1). Demographic variables were entered first, general ability 
second, and motivational factors last. The sequence reflected our goals to 
understand, first of all, the contribution of general cognitive ability to the prediction 
of achievement and choice above and beyond demographic (or sociological) factors, 
and second, more importantly, the incremental predictive validity of motivational 
factors above and beyond demographic and cognitive factors. Path coefficients 
(standardized regression coefficients) and for sequential models are shown in 
Table 6. Path diagrams depicting the network of relations among the constructs are 
shown in Figures 2 to 4. 




Figure 2. Path diagram depicting relations among ability, motivational beliefs, engagement, 
and science test scores. 
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Figure 3. Path diagram depicting relations among ability, motivational beliefs, engagement, 
and science grades. 




Figure 4. Path diagram depicting relations among ability, motivational beliefs, engagement, 
and choice of science-related college majors and careers. 



Table 6 

Standardized Regression Coefficients for Demographic Characteristics, Ability, and Motivational Factors Predicting Achievement and Choice 
(N = 286) 
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included demographic characteristics, ability, and motivational factors. Gender is coded 0 = Males, 1 = Females; Race is coded 0 
White, 1 = White. . 

*p < .05. **p < .0}. 



Direct Relations 



To examine direct relations, a series of sequential regression analyses was 
conducted. First, regressing science test scores on the full set of predictors produced 
significant positive relations for general ability (P = .51, p < .01), competence beliefs 
(p = .19, p < .01), task values (p = .15, p < .01), and test engagement (p = .14, p < .01). 
Second, regressing science grades on the predictors produced significant positive 
relations for general ability (P = .37, p < .01), competence beliefs (P = .23, p < .01), and 
classroom engagement (P = .28, p < .01). Third, regressing choice on the predictors 
produced a significant positive relation for task values only (P = .51, p < .01) 

The full set of predictors accounted for a sizable amount of variance in science 
test score (adjusted = .61), less variance in science grade (adjusted = .45), and 
least in choice (adjusted R^ = .37). The incremental variance contributed by general 
ability above and beyond demographic factors was the largest for science test score 
{R^ change = .24), somewhat smaller for grade {R^ change = .15), and almost 
negligible for choice {R^ change = .01). The reverse pattern was true for motivational 
factors. The incremental variance contributed by motivational factors above and 
beyond demographic factors and general ability rose from science test scores {R^ 
change = .09) to science grades {R^ change = .12) and to choice {R^ change = .32). 

Mediational Relations 

To examine whether engagement variables (test and classroom engagement) 
mediated the relations between motivational variables (competence beliefs, and task 
values) and the outcomes (science test score, grade, and choice), we regressed the 
engagement variables on the predictors. For classroom engagement, positive 
relations were found for competence beliefs (P = .39, p < .01) and task values (P = .34, 
p < .01). Similarly, for test engagement, significant positive relations were found for 
competence beliefs (P = .18, p < .01) and task values (P = .20, p < .01). The results are 
summarized in Table 7 and the path diagrams are shown in Figures 2 to 4. 

Furthermore, to examine whether motivational variables mediated the relations 
between general ability and engagement variables, we regressed motivational 
variables on general ability. General ability was found to have a significant positive 
relation with competence beliefs (P = .31, p < .01), but not with task values (P = .10, p 
> .05). The results are summarized in Table 8. 
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Table 7 

Standardized Regression Coefficients for Demographic Characteristics, Ability, and Motivational 
Factors Predicting Engagement (N = 286) 





Classroom engagement 
composite 




Test engagement 
composite 


Predictor 


Model 1 


Model 2 


Model 3 


Model 1 Model 2 


Model 3 


Step 1 

Parental education 


0.25** 


0.23** 


0.11 


0.07 


0.06 


0.01 


Gender 


0.14* 


0.15** 


0.27** 


-0.11 


-0.11 


-0.05 


Race 


-0.02 


-0.03 


-0.04 


0.13 


0.13 


0.13 


Step 2 

General ability 




0.07 


-0.08 




0.01 


-0.06 


Step 3 

Competence beliefs composite 
Task values 






0.39** 

0.34** 






0.18** 

0.20** 


Total 


0.08 


0.08 


0.41 


0.04 


0.04 


0.14 


Total adjusted 


0.07 


0.07 


0.40 


0.03 


0.03 


0.12 


R ^ change 


0.08** 


0.00 


0.33** 


0.04** 0.00 


0.09** 



Note. Model 1 included students' demographic characteristics only; Model 2 included demographic 
characteristics and ability; Model 3 included demographic characteristics, ability, and motivational 
factors. Gender is coded 0 = Males, 1 = Females; Race is coded 0 = Non- White, 1 = White. 

* p < .05. ** p < .01. 



As indicated in the path diagrams (Figures 2 to 4), general ability had direct 
paths to science test scores and grades and indirect paths to them through the 
mediation of competence beliefs and engagement variables. Both competence beliefs 
and task values had direct paths to both test engagement and classroom 
engagement. Whether test engagement or classroom engagement served as a 
mediator depended on the types of assessment. Test engagement had a direct path 
to science test scores but not science grades, whereas classroom engagement had a 
direct path to science grades but not science test scores. 
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Table 8 



Standardized Regression Coefficients for Demographic Characteristics and Ability 
Predicting Motivational Beliefs (N = 286) 





Competence beliefs 
composite 


Task values 


Predictor 


Model 1 


Model 2 


Model 1 


Model 2 


Step 1 

Parental education 


0.24** 


0.16** 


0.16* 


0.13 


Gender 


-0.26** 


-0.21** 


-0.10 


-0.09 


Race 


0.13* 


0.05 


-0.01 


-0.03 


Step 2 

General ability 




0.31** 




0.10 


Total R" 


0.18 


0.25 


0.03 


0.04 


Total adjusted R^ 


0.17 


0.24 


0.02 


0.03 


R^ change 


0.18** 


0.07** 


0.03* 


0.01 



Note. Model 1 included students' demographic characteristics only; Model 2 
included demographic characteristics and ability. Gender is coded 0 = Males, 1 = 
Females; Race is coded 0 = Non-White, 1 = White. 

*p<.05. **p<.0l. 



Discussion and Conclusions 

Direct Relations 

The full set of predictors accounted for 61% of variance in science test scores, 
48% in science grades, and 39% in anticipated choice of science majors and careers. 
The results demonstrated the high predictive validity of the model. For achievement 
outcomes, both cognitive and motivational factors have significant links to science 
test scores and grades. The inclusion of motivational factors increases the predictive 
validity of the model, as evidenced by the significant changes in 

Though general ability accounted for the largest amount of variance in science 
achievement, several aspects of the results underscore the influential role of 
motivational factors in predicting the outcomes. First, the incremental predictive 
validity of motivational factors was tested under a very stringent criterion. The 
changes in in Model 3 (see Table 6) reflected the incremental variance above and 
beyond demographic and cognitive factors, which have been shown to be major 
predictors of achievement in previous research. Incremental variance contributed by 
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motivational factors would have been larger if these factors had been entered first in 
the regression model. Second, even though motivational factors were entered last, 
incremental variance contributed by motivational factors {R^ change = .12) is 
comparable to that contributed by general ability {R^ change = .15) in predicting 
science grade. Third, for the non-achievement outcome (choice of science majors and 
careers), motivational factors— and, in particular, task values— contributed the 
largest amount of incremental variance. 

The relative contributions of cognitive and motivational factors to the 
prediction of science achievement depended on the types of assessment (science test 
scores vs. science grades). Specifically, general ability contributed a larger 
incremental variance to predicting test scores than grades, whereas the reverse 
pattern was true for motivational factors. One possible reason is that test scores and 
grades reflect different types of achievement situations. Whereas science test scores 
reflect a one-shot assessment under a time limit, science grades reflect cumulative 
achievement over a semester and are assessed by several criteria, including the 
degree of participation in science class, the quality and quantity of homework 
completed, and performance in class exams. Motivational factors, such as effort, 
attention, classroom engagement, and persistence, being extended over a long 
period time, are more likely to enhance students' grades than their test scores. 

Mediated Relations 

Another important goal of this study was to understand the mediating 
processes linking various constructs in the model. Both competence beliefs and task 
values had direct paths to science test scores and indirect paths through the 
mediation of test engagement. Competence beliefs had a direct path to science 
grades and an indirect path through the mediation of classroom engagement. Task 
values had only an indirect path to science grades, through classroom engagement. 
The pattern of results supports the self-system process model, which assumes that 
action mediates the relation between self-system processes and outcomes. 

Furthermore, the results underscore the importance of achievement contexts in 
determining the mediating mechanisms. Whereas test engagement predicted test 
scores but not grades, classroom engagement predicted grades but not test scores. In 
our study, test engagement was assessed by students' self-reports of their mood, 
energy, cognitive strategy use, and cognitive effort expended during the test. The 
self-reports were obtained immediately after students had taken the test. Students' 
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cognitive, motivational, and affective processes during the test were expected to be 
more important than what they do in the classroom in determining achievement. A 
similar line of argument applies to reverse patterns for science grades. 

In the path models, general ability had a direct path to science test scores and 
grades and an indirect path through the mediation of competence beliefs. The 
positive relation between general ability and competence beliefs worked to eiahance 
the relation between general ability and achievement. General ability did not have 
direct paths to any other motivational factors, however. This result indicates that the 
performance (or cognitive) pathway is relatively independent of the commitment (or 
motivational) pathway, with the exception that competence beliefs serve as the point 
of contact between the two. 

Conclusions and Implications 

In corroboration of Snow's (1989, 1992) aptitude theory, this study has 
provided empirical evidence for the conjoint contribution of cognitive and 
motivational factors to predicting science achievement, engagement, and choice 
among high school students. Our results not only replicate the well-documented 
relations between cognitive ability and academic achievement, but also demonstrate 
that the inclusion of motivational variables increases the predictive validity of the 
model. Theoretical implications of our findings are that a multidimensional 
approach to achievement validation is essential and that researchers need to adopt a 
"whole person" approach in order to understand the complexity of academic 
achievement. An educational implication is that teachers and parents can promote 
students' academic performance both by influencing their competence beliefs, task 
values, and patterns of engagement (the commitment pathway) and by influencing 
their knowledge representation, procedural skills, and metacognitive strategies 
(performance pathway). Our findings lead us to expect that the most effective 
instructional methods are the ones that impact both cognitive and motivational 
functioning of students. 

Consistent with Connell and Wellborn's (1991) self-system theory, this study 
has also provided evidence for the mediating role of engagement, through which 
cognitive ability and motivational processes are linked to academic achievement. 
Although engagement is considered to be a means (mediator) to an end 
(achievement) in our conceptual model, it is important to note that engagement 
should also be regarded as a desired outcome of education. 
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